Local effective dynamics of quantum systems: A generalized approach to work and 

heat 
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By computing the local energy expectation values with respect to some local measurement basis 
we show that for any quantum system there are two fundamentally different contributions: changes 
in energy that do not alter the local von Neumann entropy and changes that do. We identify the 
former as work and the latter as heat. Since our derivation makes no assumptions on the system 
Hamiltonian or its state, the result is valid even for states arbitrarily far from equilibrium. Examples 
are discussed ranging from the classical limit to purely quantum mechanical scenarios, i.e. where 
the Hamiltonian and the density operator do not commute. 
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The formulation of classical thermodynamics was one 
of the most important achievements of the 19 th century, 
as it allowed to investigate a large variety of phenomena, 
including the workings of thermodynamical machines. 
The first law of thermodynamics, 



dU = dW + dQ, 



(1) 



combined with definitions for the infinitesimal change in 
work dW and heat dQ and the second law is all that 
is required for computing important quantities like the 
efficiency of a process. 

In the quantum realm, the classification of work and 
heat is less clear. So far, it has mainly been based on the 
change of the total energy expectation value 



dU = dTr {tfpj = Tr [pdH + iJdpj , 



(2) 



and defining the first term as dW and the second as dQ 
P> SB BUI- However, such a classification can be prob- 
lematic, for various reasons: For one, it is not obvious 
how to apply this definition to processes involving an in- 
ternal transfer of work and heat, as is the case, e.g., in 
algorithmic cooling, a method to obtain highly polarized 
spins by applying a series of quantum gates [6(. Then, 
the microscopic foundation of ([2]) is rather unclear: As 
thermodynamic behavior may occur even in small quan- 
tum systems 0, it should, in principle, be possible to 
obtain dW and dQ even there. In the following, we will 
present an alternative definition that does not suffer from 
the problems above. 

This letter is organized as follows. We first discuss the 
local effective dynamics of a bipartite quantum system. 
This dynamics of one part of the system is a reduced dy- 
namics, which depend on the state of and the interaction 
with the rest of the system. Because we are interested in 
local properties of a part of the system, it is necessary to 
get a complete local description. In contrast to, e.g., a 
Markovian quantum master equation (see, e.g., Q) the 
reduced dynamics cannot expected to be a set of closed 



differential equations. Based upon what an experimen- 
talist might observe, we give a definition for the local 
energy. We then show that the change in this local en- 
ergy can always be split into a part that correlates with 
a change in entropy and in a part which does not. Corre- 
sponding to classical thermodynamics, the former will be 
called "heat" and the latter "work" . However, this defi- 
nition for the local heat and work does not only depend 
on local properties, but on details of the whole system. 
We explicitly give formulas to calculate those local quan- 
tities once the time evolution of the full system is known. 
Finally, two examples will be given, for illustration. 

While work and heat can thus always be introduced to 
characterize the energy exchange between two quantum 
subsystems, this splitting lacks, in general, the robust- 
ness and universality, which is typical for the correspond- 
ing thermodynamic concept. Additional investigations 
are needed to show under which conditions this work and 
heat may be identified with their thermodynamic coun- 
terparts. (This is reminiscent of entropy, which also can 
be defined for any quantum state, but its relationship 
to the thermodynamic variant requires further analysis.) 
However, it is necessary to develop generalized concepts 
for work and heat if one wants to analyze question re- 
quiring both quantum mechanics and thermodynamics, 
like when investigating the influence of coherence on the 
efficiency of a quantum machine. 

We consider an autonomous bipartite system described 
by the Hamiltonian 



H = H A + H B + H AB , 



(3) 



where Ha acts on subsystem A and Hb on B, respec- 
tively. We now focus on the local properties of subsystem 
A only, however our scheme would work also for subsys- 
tem B. The problem of local addressability has been 
discussed intensively in quantum computing |6|. A local 
measurement of work or heat will have to be be based on 
a coupling to a heat bath or work reservoir, respectively. 
(The energy exchanged with a bath must be heat, that 
with a "mechanical" reservoir work, by definition.) In 
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TABLE I: Comparison of the scenarios when coupling a sys- 
tem to a heat bath or a work reservoir, depending on the 
interaction Hamiltonian. 





work reservoir 


heat bath 




dU = SW = 


dU = dQ yi 




dU = dw 


dU = dQ = 



both cases the coupling will be realized by an interaction 
Hamiltonian Ham of the type 

H AM X! 1 ' U '- ( 4 ) 

where the operators act only on subsystem A, and 
the Mi only on the measuring device M. Choosing the 
operators Ai may seem rather arbitrary, but can have 
important consequences on the observed values. For ex- 
ample, let us consider a system with an effective local 
Hamiltonian 

Hf = ^fa z . (5) 

We now consider four cases: first, the system will be cou- 
pled to a work reservoir, which can always be modeled by 
a classical driver, as the work reservoir must always have 
zero entropy, by definition. We use A4 = A = g sin(u)t)& x 
and A — gsm.(<A)t)a z , respectively. For simplicity, we as- 
sume that the driving frequency is off-resonant with re- 
spect to the eigenfrequency of H A S . Therefore, in the 
b x case there will be no transfer of energy, while in the 
a z case dU is non-zero, and all energy is transferred as 
work. We then repeat the process when coupling the 
system to a heat bath. Here, we have A — \a x and 
A = A<7 2 , respectively. In the a x case, this results in sys- 
tem relaxing to a canonical state pa — Z^ 1 exp(—/3H A s ), 
with p being the inverse temperature. However, the a z 
coupling results in a pure dephasing of the system, i.e, 
dU = dQ = 0. A summary of the possible combinations 
is shown in Table [IJ 

The concrete physical realization thus defines a local 
effective measurement basis (LEMBAS), which provides 
a reference for all measurements of work or heat. Which 
choice of basis is the "correct" one, cannot be decided by 
the LEMBAS principle. However, there are typically only 
a few choices which are physically reasonable, which then 
can be further checked for consistency. A constructive 
procedure that would allow to identify the correct basis 
is beyond the scope of this letter. 

In the following we do not consider the effect of the 
actual measurement on the dynamics of the system. We 
only assume that some fixed basis has been chosen as 
required by the LEMBAS principle, and then compute 
work and heat with respect to this basis. Note that this 
procedure is similar to a hypothetic von Neumann mea- 
surement - the probability for each outcome can be cal- 



culated without including the measurement device in the 
dynamics. 

We now define the infinitesimal work SWa performed 
on A as the change in its internal energy dUA that does 
not change its local von Neumann entropy, i.e. 

dS A = 0& dW A = dU A - (6) 

The remainder is defined as the infinitesimal heat dQ. It 
is important to note that work and heat will then turn 
out to be basis-dependent quantities as they depend on 
the choice of the measurement basis. 

The dynamics of the subsystem A is given by the 
Liouville-von Neumann equation 

^PA = -i[H A + Hf, p A ] + AncGS), (7) 

where p A is the reduced density operator of A, H A S is an 
effective Hamiltonian (see below) describing the unitary 
dynamics induced by B on A, and £i nc is a superoper- 
ator describing incoherent processes, which may derive 
from the environment of the total bipartite system (if 
present), but here, in particular, from the influence of B 
on A. Since C{ nc is, in general, a function of the den- 
sity operator of the full system, Eq. ((TJ is typically not a 
closed differential equation for p A ■ 

In the following we choose the energy basis of subsys- 
tem A as the measurement basis, so that only the parts of 
the total effective Hamiltonian H A S that commute with 
Ha contribute to the described type of experiment. To 
find this part Hf s , we expand H^ in the transition op- 
erator basis defined by the energy eigenstates {\j)} of 
H A - 

Hf = J^(Hf) jk \j}{k\ (8) 

jk 

For this operator basis, we have 

[\j)(k\,H A ]=c kj \j){k\, (9) 

where LOkj is the difference between the energy eigenval- 
ues of the states and \j), and therefore uijj — for 
non-degenerate energy eigenvalues. Now, we define 

Hf = J2(Hf)n\j)(j\ (10) 

3 

which is the diagonal part of H A S . From Eq. ([9]), we see 
that no non-zero linear combination of transition opera- 
tors with j k can ever commute with Ha and therefore, 
neither H^ = H A S — H° s 1 nor any part of it commutes 
with Ha- Hence, Hf s is the part contributing to the 
measurement, as required, and we have 

[Hf,H A } = 0,[Hf,H A }^0. (If) 

The latter inequality holds except for the case where 
if| ff = 0- A n analogous result can be achieved in the 
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case of degenerate eigenvalues of H A but has been omit- 
ted for the sake of brevity and clarity. 

If a measurement of the local energy is performed in 
the energy eigenbasis of H A the corresponding operator 
is 



H' A — Ha + HI 



ctr 



(12) 



Therefore the change in internal energy within A is given 
by 

dU A = ^Tr [h' a pa] dt = Tr {k 1 p A + H' A p A ) At. 

(13) 

Using ||7J) and assuming Ha to be time-independent leads 
to 

dU A = Tr [tfpA - i[H>, Hf]p A + H' A C mc (p)} dt, 

(14) 

where the cyclicity of the trace has been used. Observ- 
ing that the dynamics induced by the first two terms is 
unitary, we arrive at 

dW A = Tr {Hf pa- i[H',Hf]p A }dt (15) 

dQ A = Tr {i%Anc(/3)} dt. (16) 

In this sense, it is possible to define heat and work for 
any quantum mechanical process, regardless of the type 
of dynamics or the states involved. 

In order to actually compute dW and dQ the effec- 
tive Hamiltonian H A is required. By starting with the 
Liouville-von Neumann equation for the full system 



^ = -i[£,p] 



(17) 



and taking the partial trace over B (see e.g. |8|) yields 
9 



-p A =Tr B {[H A 



Hn + H 



AB 



(18) 



Using some theorems on partial traces shows that terms 
involving Hb vanish and Ha generates the local dynam- 
ics in A. For dealing with the terms involving Hab we 
first split the density operator as 



p = PA® Pb + C A i 



(19) 



where Pa,b are the reduced density operators for A and 
B, respectively, and Cab is the operator describing the 
correlations between both subsystems. Since the factor- 
ization approximation is exact for the first term, we can 
write (cf. @) 



Tv B { [H AB , pa ® Pb] } = [Hf, p A ] , 



where Hf is given by 



Hf = Tib 



{HabO-a® Pb)\ 



(20) 



(21) 



Now we show that the processes generated by 
[Hab, Cab] cannot result in unitary dynamics, but will 
always change the local von Neumann entropy Sa- In 
order to prove this, we convince ourselves that its time 
derivative is non-zero, i.e, 



S A = -Tr {[H AB , Cab] \ogp A ® U) £ 



0. 



(22) 



Therefore, any dynamics generated by this term results 
in a contribution to Ci nc . If the dynamics of the full 
system was unitary, we would thus simply have 



= -iTr, 



{[H AB , Cab]} 



(23) 



as the total incoherent term. 

How are these alternative definitions of heat and work 
linked to Eq. |2])? It is easy to check that for H^ — 
the definitions are compatible. A pertinent example 
refers to a quasistatic process within the system A — B in 
thermal equilibrium at temperature T. From the Gibbs 
fundamental relation it is known that 



dS A = ^rdQ A - 

J-A 



(24) 



Using now the definition given for the heat in (|16[) we get 

dS A = ^Tr {H' A C inc (p)\dt. (25) 
1 A i i 

Here, T A specifies a parameter to be associated with 
the local temperature. This parameter follows from the 
derivation of the entropy Sa from (|22[) combined with 
(HI 



-Tr {Anc(p) logp A } = ^Tr {H' A C inc (p)} 

Tr {H' A £ inc (p)} 
Tr {£i nc (p) log pa} 



n 



(26) 



For canonical states H' A commutes with p A and C lric (p a) , 
and by using Eq. ([T4")) it can be seen that Eq. (|2"6")) is 
equivalent to the classical definition 



Tt =T A 



OUa 
OS a 



(27) 



However, T A is not necessarily equal to the global tem- 
perature T of the full system due to the interaction be- 
tween the individual subsystems inducing correlations 

13, El- 

Using the LEMBAS principle, it is now possible to 
investigate work and heat also in non-standard physical 
scenarios. First we consider a two-level atom with a local 
Hamiltonian H A interacting with a laser field (subsystem 
B). In the semiclassical treatment of the radiation field 
emitted by a laser the respective Hamiltonian is given by 



H=H A 



Hf 



AE 



isin(uit)a x , (28) 
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|1> 
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|0> 



qubit A 



qubit B 



|H> 
|10> — 

|oi>- 

|00)- 
entire system 



FIG. 1: Scheme of the SWAP gate and the accounting 7r-pulse. 



where g is the coupling strength and to the laser fre- 
quency. In the rotating wave approximation the Hamilto- 
nian can be made time-independent. We investigate the 
situation where the atom is initially in a thermal state 
described by the density operator 



p A (0) = Z^expi-PHA), 



(29) 



with Z being the partition function and (3 the inverse 
temperature. The time-evolution of the density operator 
PA(t) can be obtained by switching to the rotating frame 
and diagonalizing the Hamiltonian. 

Since (|28[) is already an effective description for A, we 
can directly compute SWa and SQa once we know pA(t), 
resulting in 



dW A (S,g) = ^^-tanh^^sin <>/ 



211 



SQa = 0, 



(30) 
(31) 



where fi = y/ g 2 + 5 2 is the Rabi frequency and 5 — 
lu — AE/h is the detuning from the resonance frequency. 
SWa is the energy stored in A that could be retrieved 
after the preparing field has been switched off at time 
fit = 7r/2. For comparison, using the previously used 
definition for the work [Eq. ©] one was led to 



SW A (S,g) = 



(AE- 



2fl 



5)g\ BAE . 

■ tanh — - — sin S It. 



(32) 



Comparison of the two results shows that in the latter 
case the maximum is not at the resonance frequency (5 = 
0), i.e., only our generalized approach is able to produce 
the correct physical result. 

As a second example we investigate the implications 
of our generalized concept in the context of algorithmic 
coo ling . Recently an algorithm published by Boykin et 
al. Jl2| has found experimental realization by Baugh et 
al. [1 31 ] and its thermodynamic properties where investi- 
gated by Rempp et al. [lj]. Of course, not all qubits [i. e. 
two level systems (TLS) used for quantum computing] 
are cooled down this way, some, the so called auxiliary 
qubits, are heated up as well and thus have to be dis- 
carded or coupled to the environment to work again as 



auxiliaries. The simplest system to perform algorithmic 
cooling consists of two noninteracting TLS with different 
Zeeman splitting (AEa < AEb) at the same initial in- 
verse temperature Pi. The cooling algorithm is a single 
SWAP gate, which interchanges the occupation probabil- 
ities between the two spins (see Fig. [I}; this implies a final 
inverse temperature Pf = (AEb/ AEa) Pi of the cooled 
spin. This one-step cooling of a finite system (here one 
spin) reminds of a refrigerator and thus should be char- 
acterized by properties like the efficiency rj = Q/W. To 
distinguish between work W and heat Q one needs to 
apply the local treatment described above. If one would 
just use Eq. ((2]) the heat would be Q — because the 
entropy of the total system does not change. Therefore, 
it is necessary to apply our generalized approach. 

Again, in the semi-classical treatment of the subsystem 
C inducing the SWAP gate between the |01) and 1 10) lev- 
els the Hamiltonian in the rotating wave approximation 
reads (index j shown in Fig. [T]) 



H(t) =H A B+H- vA (t)=Y t E j P Sj 



3=1 



+ 1 g (V (E 3 -E 2 ) tp 23 + e -i (E 3 -E 2 ) tp^ (33) 

with Y^=i e j p jj = T,^=a,b AE n °% representing the 
spectrum of the two uncoupled spins. To solve the equa- 
tions of motion of this Hamiltonian we transform into 
the rotating basis to get rid of the time-dependence of 
the Hamiltonian [15| 



H Iot = U xot (t)H(t)U-l(t). 



(34) 



Thus we are able to calculate the infinitesimal change 
of work dV^AB done by the subsystem C on the two-spin 
system by means of Eq. (TPo)) , 



SWab = \Z~ X (e 



PiAE A 



e^ AEB ) (AE A - AE B ) sin gt 

(35) 

where Z is the partition function of the system. To get 
the work Wab induced by a SWAP we have to integrate 
over a half period of the Rabi oscillation. Because there 
is no detuning this is the same result as if calculated 
directly via Eq. ([2]). As in the previous example SQab = 
0, i.e., subsystem C only imparts work. Interestingly 
enough, the situation changes when we only look at A: 
To compute the transferred heat Qa we have to apply 
the LEMBAS principle to investigate the local change of 
energy that is related to a change of the local entropy. 
We use (l2lT) to find the effective Hamiltonian 



itf 



3 ft (AEa+ABb) 



Z- X AE B 



3 /3 4 AE E 

?a- 



a z AE 



0i AEa) 



Z^ 1 AE B cos(gt)} 



(36) 
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From the fact that [a , a z ] = it follows that Hf = H' A 



and 



±p A (t) = ±Tr B {/>(*)} = 4, 



(37) 



Using Eq. (TTo) yields 



SQ A = - y -Z- 1 (e 



£ z -i ^AE,_ eft A£ s ) A ^ sin (. 9 t), (38) 



which, again, has to be integrated over a half period of 
the Rabi oscillation to get Qa- This is the heat that 
would have to flow back from the original heat bath to 
let subsystem A return to its initial state. The SWAP 
gate thus has the engine efficiency tja 



VA 



AE/ 



Wab AE a - AE B 



(39) 



This is the same result as found for the quantum Otto 
process in the heat pump mode 

In summary we have shown the that exchange of en- 
ergy between two quantum systems can always be split 
into work and heat, based on local effective dynamics. 
We have demonstrated how to obtain this local effec- 
tive dynamics, once the dynamics of the full system is 
known. As this involves the choice of a measurement 
basis, those quantities are basis-dependent. The choice 
of basis remains a subtle problem; a detailed analysis of 
the environment should eventually give a unique answer, 
just as in case of a measuring apparatus with respect 
to its actual measurement basis. However, the examples 
presented show that our generalized approach can lead 
to concrete and sensible results, which is not always the 
case for the previously used one. The LEMBAS principle 
should help to investigate thermodynamic aspects at the 
borderline between full-fledged quantum dynamics and 
thermodynamics proper. 
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